Racial and ethnic associations with interstitial lung disease and healthcare utilization in patients with systemic sclerosis.

Rationale: Racial and ethnic differences in presentation and outcomes have been reported in systemic sclerosis (SSc) and SSc-interstitial lung disease (ILD). However, diverse cohorts and additional modeling can improve understanding of risk features and outcomes, which is important for reducing associated disparities. Objectives: To determine if there are racial/ethnic differences associated with SSc-ILD risk and age; time intervals between SSc and ILD, and with emergency department (ED) visit or hospitalization rates. Methods: A retrospective cohort study using electronic health record data from an integrated health system, over a 5.5 year period was conducted using clinical and sociodemographic variables, models were generated with sequential adjustments for these variables. Logistic regression models were used to examine the association of covariates with ILD and age at SSc-ILD. Healthcare outcomes were analyzed with complementary log-log regression models. Results: The cohort included 756 adults (83.6% female, 80.3% non-Hispanic White) with SSc with a mean age of 59 years. Overall, 33.7% of patients in the cohort had an ILD code, with increased odds for Asian (odds ratio [OR], 2.59; 95% confidence interval [CI], 1.29, 5.18; P =.007) compared to White patients. The age in years of patients with SSc-ILD was younger for Hispanic (mean difference, -6.5; 95% CI, -13, -0.21; P = 0.04) and Black/African American patients (-10; 95% CI -16, -4.9; P <0.001) compared to White patients. Black/African American patients were more likely to have an ILD code before an SSc code (59% compared to 20.6% of White patients), and had the shortest interval from SSc to ILD (3 months). Black/African American (HR, 2.59; 95% CI 1.47, 4.49; P =0.001) and Hispanic patients (HR 2.29; 95% CI 1.37, 3.82; P =0.002) had higher rates of an ED visit. Conclusion: In this study, SSc-ILD presentation and outcomes differed by racial/ethnic group (increased odds of SSc-ILD, younger age at SSc-ILD, and preceding diagnosis with respect to SSc, rates of ED visit), some of which was attenuated with adjustment for clinical and sociodemographic characteristics. Differing presentation may be driven by social drivers of health (SDOH), autoantibody profiles, or other key unmeasured factors contributing to susceptibility and severity.

How Safe are Outpatient Electronic Health Records? An Evaluation of Medication-Related Decision Support using the Ambulatory Electronic Health Record Evaluation Tool.

BACKGROUND: The purpose of the Ambulatory Electronic Health Record (EHR) Evaluation Tool is to provide outpatient clinics with an assessment that they can use to measure the ability of the EHR system to detect and prevent common prescriber errors. The tool consists of a medication safety test and a medication reconciliation module. OBJECTIVES: The goal of this study was to perform a broad evaluation of outpatient medication-related decision support using the Ambulatory EHR Evaluation Tool. METHODS: We performed a cross-sectional study with 10 outpatient clinics using the Ambulatory EHR Evaluation Tool. For the medication safety test, clinics were provided test patients and associated medication test orders to enter in their EHR, where they recorded any advice or information they received. Once finished, clinics received an overall percentage score of unsafe orders detected and individual order category scores. For the medication reconciliation module, clinics were asked to electronically reconcile two medication lists, where modifications were made by adding and removing medications and changing the dosage of select medications. RESULTS: For the medication safety test, the mean overall score was 57%, with the highest score being 70%, and the lowest score being 40%. Clinics performed well in the drug allergy (100%), drug dose daily (85%), and inappropriate medication combinations (74%) order categories. Order categories with the lowest performance were drug laboratory (10%) and drug monitoring (3%). Most clinics (90%) scored a 0% in at least one order category. For the medication reconciliation module, only one clinic (10%) could reconcile medication lists electronically; however, there was no clinical decision support available that checked for drug interactions. CONCLUSION: We evaluated a sample of ambulatory practices around their medication-related decision support and found that advanced capabilities within these systems have yet to be widely implemented. The tool was practical to use and identified substantial opportunities for improvement in outpatient medication safety.

Correction: Performance of a Web-Based Reference Database With Natural Language Searching Capabilities: Usability Evaluation of DynaMed and Micromedex With Watson.

[This corrects the article DOI: 10.2196/43960.].

Performance of a Web-Based Reference Database With Natural Language Searching Capabilities: Usability Evaluation of DynaMed and Micromedex With Watson.

BACKGROUND: Evidence-based point-of-care information (POCI) tools can facilitate patient safety and care by helping clinicians to answer disease state and drug information questions in less time and with less effort. However, these tools may also be visually challenging to navigate or lack the comprehensiveness needed to sufficiently address a medical issue. OBJECTIVE: This study aimed to collect clinicians' feedback and directly observe their use of the combined POCI tool DynaMed and Micromedex with Watson, now known as DynaMedex. EBSCO partnered with IBM Watson Health, now known as Merative, to develop the combined tool as a resource for clinicians. We aimed to identify areas for refinement based on participant feedback and examine participant perceptions to inform further development. METHODS: Participants (N=43) within varying clinical roles and specialties were recruited from Brigham and Women's Hospital and Massachusetts General Hospital in Boston, Massachusetts, United States, between August 10, 2021, and December 16, 2021, to take part in usability sessions aimed at evaluating the efficiency and effectiveness of, as well as satisfaction with, the DynaMed and Micromedex with Watson tool. Usability testing methods, including think aloud and observations of user behavior, were used to identify challenges regarding the combined tool. Data collection included measurements of time on task; task ease; satisfaction with the answer; posttest feedback on likes, dislikes, and perceived reliability of the tool; and interest in recommending the tool to a colleague. RESULTS: On a 7-point Likert scale, pharmacists rated ease (mean 5.98, SD 1.38) and satisfaction (mean 6.31, SD 1.34) with the combined POCI tool higher than the physicians, nurse practitioner, and physician's assistants (ease: mean 5.57, SD 1.64, and satisfaction: mean 5.82, SD 1.60). Pharmacists spent longer (mean 2 minutes, 26 seconds, SD 1 minute, 41 seconds) on average finding an answer to their question than the physicians, nurse practitioner, and physician's assistants (mean 1 minute, 40 seconds, SD 1 minute, 23 seconds). CONCLUSIONS: Overall, the tool performed well, but this usability evaluation identified multiple opportunities for improvement that would help inexperienced users.

Development and validation of algorithms to build an electronic health record based cohort of patients with systemic sclerosis.

OBJECTIVES: To evaluate methods of identifying patients with systemic sclerosis (SSc) using International Classification of Diseases, Tenth Revision (ICD-10) codes (M34*), electronic health record (EHR) databases and organ involvement keywords, that result in a validated cohort comprised of true cases with high disease burden. METHODS: We retrospectively studied patients in a healthcare system likely to have SSc. Using structured EHR data from January 2016 to June 2021, we identified 955 adult patients with M34* documented 2 or more times during the study period. A random subset of 100 patients was selected to validate the ICD-10 code for its positive predictive value (PPV). The dataset was then divided into a training and validation sets for unstructured text processing (UTP) search algorithms, two of which were created using keywords for Raynaud's syndrome, and esophageal involvement/symptoms. RESULTS: Among 955 patients, the average age was 60. Most patients (84%) were female; 75% of patients were White, and 5.2% were Black. There were approximately 175 patients per year with the code newly documented, overall 24% had an ICD-10 code for esophageal disease, and 13.4% for pulmonary hypertension. The baseline PPV was 78%, which improved to 84% with UTP, identifying 788 patients likely to have SSc. After the ICD-10 code was placed, 63% of patients had a rheumatology office visit. Patients identified by the UTP search algorithm were more likely to have increased healthcare utilization (ICD-10 codes 4 or more times 84.1% vs 61.7%, p < .001), organ involvement (pulmonary hypertension 12.7% vs 6% p = .011) and medication use (mycophenolate use 28.7% vs 11.4%, p < .001) than those identified by the ICD codes alone. CONCLUSION: EHRs can be used to identify patients with SSc. Using unstructured text processing keyword searches for SSc clinical manifestations improved the PPV of ICD-10 codes alone and identified a group of patients most likely to have SSc and increased healthcare needs.

Dynamic reaction picklist for improving allergy reaction documentation: A usability study.

OBJECTIVE: To assess novel dynamic reaction picklists for improving allergy reaction documentation compared to a static reaction picklist. MATERIALS AND METHODS: We developed three web-based user interfaces (UIs) mimicking the Mass General Brigham's EHR allergy module: the first and second UIs (i.e., UI-1D, UI-2D) implemented two dynamic reaction picklists with different ranking algorithms and the third UI (UI-3S) implemented a static reaction picklist like the one used in the current EHR. We recruited 18 clinicians to perform allergy entry for 10 test cases each via UI-1D and UI-3S, and another 18 clinicians via UI-2D and UI-3S. Primary measures were the number of free-text entries and time to complete the allergy entry. Clinicians were also interviewed using 30 questions before and after the data entry. RESULTS AND DISCUSSIONS: Among 36 clinicians, less than half were satisfied with the current EHR reaction picklists, due to their incomprehensiveness, inefficiency, and lack of intuitiveness. The clinicians used significantly fewer free-text entries when using UI-1D or UI-2D compared to UI-3S (p < 0.05). The clinicians used on average 51 s (15 %) less time via UI-1D and 50 s (16 %) less time via UI-2D in completing the allergy entries versus UI-3S, and there was not a statistically significant difference in documentation time for either group between the dynamic and static UIs. Overall, 15-17 (83-94 %) clinicians rated UI-1D and 13-15 (72-83 %) clinicians rated UI-2D as efficient, easy to use, and useful, while less than half rated the same for UI-3S. Most clinicians reported that the dynamic reaction picklists always or often suggested appropriate reactions (n = 30, 83 %) and would decrease the free-text entries (n = 26, 72 %); nearly all preferred the dynamic picklist over the static picklist (n = 32, 89 %). CONCLUSION: We found that dynamic reaction picklists significantly reduced the number of free-text entries and could reduce the time for allergy documentation by 15%. Clinicians preferred the dynamic reaction picklist over the static picklist.

Reconciling Allergy Information in the Electronic Health Record After a Drug Challenge Using Natural Language Processing.

Background: Drug challenge tests serve to evaluate whether a patient is allergic to a medication. However, the allergy list in the electronic health record (EHR) is not consistently updated to reflect the results of the challenge, affecting clinicians' prescription decisions and contributing to inaccurate allergy labels, inappropriate drug-allergy alerts, and potentially ineffective, more toxic, and/or costly care. In this study, we used natural language processing (NLP) to automatically detect discrepancies between the EHR allergy list and drug challenge test results and to inform the clinical recommendations provided in a real-time allergy reconciliation module. Methods: This study included patients who received drug challenge tests at the Mass General Brigham (MGB) Healthcare System between June 9, 2015 and January 5, 2022. At MGB, drug challenge tests are performed in allergy/immunology encounters with routine clinical documentation in notes and flowsheets. We developed a rule-based NLP tool to analyze and interpret the challenge test results. We compared these results against EHR allergy lists to detect potential discrepancies in allergy documentation and form a recommendation for reconciliation if a discrepancy was identified. To evaluate the capability of our tool in identifying discrepancies, we calculated the percentage of challenge test results that were not updated and the precision of the NLP algorithm for 200 randomly sampled encounters. Results: Among 200 samples from 5,312 drug challenge tests, 59% challenged penicillin reactivity and 99% were negative. 42.0%, 61.5%, and 76.0% of the results were confirmed by flowsheets, NLP, or both, respectively. The precision of the NLP algorithm was 96.1%. Seven percent of patient allergy lists were not updated based on drug challenge test results. Flowsheets alone were used to identify 2.0% of these discrepancies, and NLP alone detected 5.0% of these discrepancies. Because challenge test results can be recorded in both flowsheets and clinical notes, the combined use of NLP and flowsheets can reliably detect 5.5% of discrepancies. Conclusion: This NLP-based tool may be able to advance global delabeling efforts and the effectiveness of drug allergy assessments. In the real-time EHR environment, it can be used to examine patient allergy lists and identify drug allergy label discrepancies, mitigating patient risks.

Identifying and Reconciling Patients' Allergy Information Within the Electronic Health Record.

Allergy information is often documented in diverse sections of the electronic health record (EHR). Systematically reconciling allergy information across the EHR is critical to improve the accuracy and completeness of patients' allergy lists and ensure patient safety. In this retrospective cohort study, we examined the prevalence of incompleteness, inaccuracy, and redundancy of allergy information for patients with a clinical encounter at any Mass General Brigham facility between January 1, 2018 and December 31, 2018. We identified 4 key places in the EHR containing reconcilable allergy information: 1) allergy modules (including free text comments and duplicate allergen entries), 2) medication laboratory tests results, 3) oral medication allergy challenge tests, and 4) medication orders that have been discontinued due to adverse drug reactions (ADRs). Within our cohort, 718,315 (45.2% of the total 1,588,979) patients had an active allergy entry; of which, 266,275 (37.1%) patient's records indicated a need for reconciliation.

Heterogeneity of Drug Allergies and Reaction Lists in Two U.S. Health Care Systems' Electronic Health Records.

BACKGROUND: Health care institutions have their own "picklist" for clinicians to document adverse drug reactions (ADRs) into the electronic health record (EHR) allergy list. Whether the lack of a nationally standardized picklist impacts clinician data entries is unknown. OBJECTIVES: The objective of this study was to assess the impact of defined reaction picklists on clinical documentation and, therefore, downstream analytics and clinical research using these data at two institutions. METHODS: ADR data were obtained from the EHRs of patients who visited the emergency department or outpatient clinics at Brigham and Women's Hospital (BWH) and University of Colorado Hospital (UCH) from 2013 to 2018. Reported drug class ADR prevalences were calculated. We investigated the reactions on each picklist and compared the top 40 reactions at each institution, as well as the top 10 reactions within each drug class. RESULTS: Of 2,160,116 patients, 640,444 (30%) had 928,973 active drug allergies. The most commonly reported drug class allergens were similar between BWH and UCH. BWH's picklist had 48 reactions, and UCH's had 160 reactions; 29 reactions were shared by both picklists. While the top four reactions overall (rash, GI upset/nausea/vomiting, hives, itching) were identical between sites, reactions by drug class exhibited greater documentation diversity. For example, while the summed prevalence of swelling-related reactions to angiotensin-converting-enzyme inhibitors was comparable across sites, swelling was represented by two terms ("swelling," "angioedema") at BWH but 11 terms at UCH (e.g., "swelling," "edema," by body locality). CONCLUSION: The availability and granularity of reaction picklists impact ADR documentation in the EHR by health care providers; picklists may partially explain variations in reported ADRs across health care systems.

Key use cases for artificial intelligence to reduce the frequency of adverse drug events: a scoping review.

Adverse drug events (ADEs) represent one of the most prevalent types of health-care-related harm, and there is substantial room for improvement in the way that they are currently predicted and detected. We conducted a scoping review to identify key use cases in which artificial intelligence (AI) could be leveraged to reduce the frequency of ADEs. We focused on modern machine learning techniques and natural language processing. 78 articles were included in the scoping review. Studies were heterogeneous and applied various AI techniques covering a wide range of medications and ADEs. We identified several key use cases in which AI could contribute to reducing the frequency and consequences of ADEs, through prediction to prevent ADEs and early detection to mitigate the effects. Most studies (73 [94%] of 78) assessed technical algorithm performance, and few studies evaluated the use of AI in clinical settings. Most articles (58 [74%] of 78) were published within the past 5 years, highlighting an emerging area of study. Availability of new types of data, such as genetic information, and access to unstructured clinical notes might further advance the field.

The Development and Piloting of the Ambulatory Electronic Health Record Evaluation Tool: Lessons Learned.

BACKGROUND: Substantial research has been performed about the impact of computerized physician order entry on medication safety in the inpatient setting; however, relatively little has been done in ambulatory care, where most medications are prescribed. OBJECTIVE: To outline the development and piloting process of the Ambulatory Electronic Health Record (EHR) Evaluation Tool and to report the quantitative and qualitative results from the pilot. METHODS: The Ambulatory EHR Evaluation Tool closely mirrors the inpatient version of the tool, which is administered by The Leapfrog Group. The tool was piloted with seven clinics in the United States, each using a different EHR. The tool consists of a medication safety test and a medication reconciliation module. For the medication test, clinics entered test patients and associated test orders into their EHR and recorded any decision support they received. An overall percentage score of unsafe orders detected, and order category scores were provided to clinics. For the medication reconciliation module, clinics demonstrated how their EHR electronically detected discrepancies between two medication lists. RESULTS: For the medication safety test, the clinics correctly alerted on 54.6% of unsafe medication orders. Clinics scored highest in the drug allergy (100%) and drug-drug interaction (89.3%) categories. Lower scoring categories included drug age (39.3%) and therapeutic duplication (39.3%). None of the clinics alerted for the drug laboratory or drug monitoring orders. In the medication reconciliation module, three (42.8%) clinics had an EHR-based medication reconciliation function; however, only one of those clinics could demonstrate it during the pilot. CONCLUSION: Clinics struggled in areas of advanced decision support such as drug age, drug laboratory, and drub monitoring. Most clinics did not have an EHR-based medication reconciliation function and this process was dependent on accessing patients' medication lists. Wider use of this tool could improve outpatient medication safety and can inform vendors about areas of improvement.

Clinical Utility of Pharmacogenomic Data Collected by a Health-System Biobank to Predict and Prevent Adverse Drug Events.

INTRODUCTION: Medication-related harm represents a significant issue for patient safety and quality of care. One strategy to avoid preventable adverse drug events is to utilize patient-specific factors such as pharmacogenomics (PGx) to individualize therapy. OBJECTIVE: We measured the number of patients enrolled in a health-system biobank with actionable PGx results who received relevant medications and assessed the incidence of adverse drug events (ADEs) that might have been prevented had the PGx results been used to inform prescribing. METHODS: Patients with actionable PGx results in the following four genes with Clinical Pharmacogenetics Implementation Consortium (CPIC) guidelines were identified: HLA-A*31:01, HLA-B*15:02, TPMT, and VKORC1. The patients who received interacting medications (carbamazepine, oxcarbazepine, thiopurines, or warfarin) were identified, and electronic health records were reviewed to determine the incidence of potentially preventable ADEs. RESULTS: Of 36,424 patients with PGx results, 2327 (6.4%) were HLA-A*31:01 positive; 3543 (9.7%) were HLA-B*15:02 positive; 2893 (7.9%) were TPMT intermediate metabolizers; and 4249 (11.7%) were homozygous for the VKORC1 c.1639 G>A variant. Among patients positive for one of the HLA variants who received carbamazepine or oxcarbazepine (n = 92), four (4.3%) experienced a rash that warranted drug discontinuation. Among the TPMT intermediate metabolizers who received a thiopurine (n = 56), 11 (19.6%) experienced severe myelosuppression that warranted drug discontinuation. Among patients homozygous for the VKORC1 c.1639 G>A variant who received warfarin (n = 379), 85 (22.4%) experienced active bleeding and/or international normalized ratio (INR) > 5 that warranted drug discontinuation or dose reduction. CONCLUSION: Patients with actionable PGx results from a health-system biobank who received relevant medications experienced predictable ADEs. These ADEs may have been prevented if the patients' PGx results were available in the electronic health record with clinical decision support prior to prescribing.

Comparison of Medication Alerts from Two Commercial Applications in the USA.

INTRODUCTION: Medication organizations across the USA have adopted electronic health records, and one of the most anticipated benefits of these was improved medication safety, but alert fatigue has been a major issue. OBJECTIVE: We compared the appropriateness of medication-related clinical decision support alerts triggered by two commercial applications: EPIC and Seegnal's platform. METHODS: This was a retrospective comparison of two commercial applications. We provided Seegnal with deidentified inpatient, outpatient, and inpatient genetic electronic medical record (EMR)-extracted datasets for 657, 2731, and 413 patients, respectively. Seegnal then provided the alerts that would have triggered, which we compared with those triggered by EPIC in clinical care. A random sample of the alerts triggered were reviewed for appropriateness, and the positive predictive value (PPV) and negative predictive value (NPV) were calculated. We also reviewed all the inpatient and outpatient charts for patients within our cohort who were receiving ten or more concomitant medications with alerts we found to be appropriate to assess whether any adverse events had occurred and whether Seegnal's platform could have prevented them. RESULTS: Results from EPIC and the Seegnal platform were compared based on alert load, PPV, NPV, and potential adverse events. Overall, compared with EPIC, the Seegnal platform triggered fewer alerts in the inpatient (1697 vs. 27,540), outpatient (2341 vs. 35,134), and inpatient genetic (1493 vs. 20,975) cohorts. The Seegnal platform had higher specificity in the inpatient (99 vs. 0.3%; p < 0.0001), outpatient (99 vs. 0.3%; p < 0.0001), and inpatient genetic (97.9 vs. 1.2%; p < 0.0001) groups and higher sensitivity in the inpatient (100 vs. 68.8%; p < 0.0001) and outpatient (88.6 vs.78.3%; p < 0.0001) groups but not in the inpatient genetic cohort (81 vs. 78.5%; p = 0.11). We identified 16 adverse events that occurred in the inpatient setting, 11 (69%) of which potentially could have been prevented with the Seegnal platform. CONCLUSIONS: Overall, the Seegnal platform triggered 94% fewer alerts than EPIC in the inpatient setting and 93% fewer in the outpatient setting, with much higher sensitivity and specificity. This application could substantially reduce alert fatigue and improve medication safety at the same time.

Renal medication-related clinical decision support (CDS) alerts and overrides in the inpatient setting following implementation of a commercial electronic health record: implications for designing more effective alerts.

OBJECTIVE: To assess the appropriateness of medication-related clinical decision support (CDS) alerts associated with renal insufficiency and the potential/actual harm from overriding the alerts. MATERIALS AND METHODS: Override rate frequency was recorded for all inpatients who had a renal CDS alert trigger between 05/2017 and 04/2018. Two random samples of 300 for each of 2 types of medication-related CDS alerts associated with renal insufficiency-"dose change" and "avoid medication"-were evaluated by 2 independent reviewers using predetermined criteria for appropriateness of alert trigger, appropriateness of override, and patient harm. RESULTS: We identified 37 100 "dose change" and 5095 "avoid medication" alerts in the population evaluated, and 100% of each were overridden. Dose change triggers were classified as 12.5% appropriate and overrides of these alerts classified as 90.5% appropriate. Avoid medication triggers were classified as 29.6% appropriate and overrides 76.5% appropriate. We identified 5 adverse drug events, and, of these, 4 of the 5 were due to inappropriately overridden alerts. CONCLUSION: Alerts were nearly always presented inappropriately and were all overridden during the 1-year period studied. Alert fatigue resulting from receiving too many poor-quality alerts may result in failure to recognize errors that could lead to patient harm. Although medication-related CDS alerts associated with renal insufficiency had previously been found to be the most clinically beneficial alerts in a legacy system, in this system they were ineffective. These findings underscore the need for improvements in alert design, implementation, and monitoring of alert performance to make alerts more patient-specific and clinically appropriate.

The Burden of Opioid-Related Adverse Drug Events on Hospitalized Previously Opioid-Free Surgical Patients.

OBJECTIVE: Opioid analgesics are a mainstay for acute pain management, but postoperative opioid administration has risks. We examined the prevalence, risk factors, and consequences of opioid-related adverse drug events (ORADEs) in a previously opioid-free surgical population. METHODS: A retrospective, observational, cohort study using administrative, billing, clinical, and medication administration data from two hospitals. Data were collected for all adult patients who were opioid-free at admission, underwent surgery between October 1, 2015, and September 30, 2016, and received postoperative opioids. Potential ORADEs were determined based on inpatient billing codes or postoperative administration of naloxone. We determined independent predictors of ORADE development using multivariable logistic regression. We measured adjusted inpatient mortality, hospital costs, length of hospital stay, discharge destination, and readmission within 30 days for patients with and without ORADEs. RESULTS: Among 13,389 hospitalizations where opioid-free patients had a single qualifying surgery, 12,218 (91%) received postoperative opioids and comprised the study cohort. Of these, we identified 1111 (9.1%) with a potential ORADE. Independent predictors of ORADEs included older age, several markers of disease severity, longer surgeries, and concurrent benzodiazepine use. Opioid-related adverse drug events were strongly associated with the route and duration of opioids administered postoperatively: 18% increased odds per day on intravenous opioids. In analyses adjusted for several covariates, presence of an ORADE was associated with 32% higher costs of hospitalization, 45% longer postoperative length of stay, 36% lower odds of discharge home, and 2.2 times the odds of death. CONCLUSIONS: We demonstrate a high rate and severe consequences of potential ORADEs in previously opioid-free patients receiving postoperative opioids. Knowledge of risk factors and predictors of ORADEs can help develop targeted interventions to minimize the development of these potentially dangerous and costly events.

The tradeoffs between safety and alert fatigue: Data from a national evaluation of hospital medication-related clinical decision support.

OBJECTIVE: The study sought to evaluate the overall performance of hospitals that used the Computerized Physician Order Entry Evaluation Tool in both 2017 and 2018, along with their performance against fatal orders and nuisance orders. MATERIALS AND METHODS: We evaluated 1599 hospitals that took the test in both 2017 and 2018 by using their overall percentage scores on the test, along with the percentage of fatal orders appropriately alerted on, and the percentage of nuisance orders incorrectly alerted on. RESULTS: Hospitals showed overall improvement; the mean score in 2017 was 58.1%, and this increased to 66.2% in 2018. Fatal order performance improved slightly from 78.8% to 83.0% (P < .001), though there was almost no change in nuisance order performance (89.0% to 89.7%; P = .43). Hospitals alerting on one or more nuisance orders had a 3-percentage-point increase in their overall score. DISCUSSION: Despite the improvement of overall scores in 2017 and 2018, there was little improvement in fatal order performance, suggesting that hospitals are not targeting the deadliest orders first. Nuisance order performance showed almost no improvement, and some hospitals may be achieving higher scores by overalerting, suggesting that the thresholds for which alerts are fired from are too low. CONCLUSIONS: Although hospitals improved overall from 2017 to 2018, there is still important room for improvement for both fatal and nuisance orders. Hospitals that incorrectly alerted on one or more nuisance orders had slightly higher overall performance, suggesting that some hospitals may be achieving higher scores at the cost of overalerting, which has the potential to cause clinician burnout and even worsen safety.

A dynamic reaction picklist for improving allergy reaction documentation in the electronic health record.

OBJECTIVE: Incomplete and static reaction picklists in the allergy module led to free-text and missing entries that inhibit the clinical decision support intended to prevent adverse drug reactions. We developed a novel, data-driven, "dynamic" reaction picklist to improve allergy documentation in the electronic health record (EHR). MATERIALS AND METHODS: We split 3 decades of allergy entries in the EHR of a large Massachusetts healthcare system into development and validation datasets. We consolidated duplicate allergens and those with the same ingredients or allergen groups. We created a reaction value set via expert review of a previously developed value set and then applied natural language processing to reconcile reactions from structured and free-text entries. Three association rule-mining measures were used to develop a comprehensive reaction picklist dynamically ranked by allergen. The dynamic picklist was assessed using recall at top k suggested reactions, comparing performance to the static picklist. RESULTS: The modified reaction value set contained 490 reaction concepts. Among 4 234 327 allergy entries collected, 7463 unique consolidated allergens and 469 unique reactions were identified. Of the 3 dynamic reaction picklists developed, the 1 with the optimal ranking achieved recalls of 0.632, 0.763, and 0.822 at the top 5, 10, and 15, respectively, significantly outperforming the static reaction picklist ranked by reaction frequency. CONCLUSION: The dynamic reaction picklist developed using EHR data and a statistical measure was superior to the static picklist and suggested proper reactions for allergy documentation. Further studies might evaluate the usability and impact on allergy documentation in the EHR.

High-priority drug-drug interaction clinical decision support overrides in a newly implemented commercial computerized provider order-entry system: Override appropriateness and adverse drug events.

OBJECTIVE: The study sought to determine frequency and appropriateness of overrides of high-priority drug-drug interaction (DDI) alerts and whether adverse drug events (ADEs) were associated with overrides in a newly implemented electronic health record. MATERIALS AND METHODS: We conducted a retrospective study of overridden high-priority DDI alerts occurring from April 1, 2016, to March 31, 2017, from inpatient and outpatient settings at an academic health center. We studied highest-severity DDIs that were previously designated as "hard stops" and additional high-priority DDIs identified from clinical experience and literature review. All highest-severity alert overrides (n = 193) plus a stratified random sample of additional overrides (n = 371) were evaluated for override appropriateness, using predetermined criteria. Charts were reviewed to identify ADEs for overrides that resulted in medication administration. A chi-square test was used to compare ADE rate by override appropriateness. RESULTS: Of 16 011 alerts presented to providers, 15 318 (95.7%) were overridden, including 193 (87.3%) of the highest-severity DDIs and 15 125 (95.8%) of additional DDIs. Override appropriateness was 45.4% overall, 0.5% for highest-severity DDIs and 68.7% for additional DDIs. For alerts that resulted in medication administration (n = 423, 75.0%), 29 ADEs were identified (6.9%, 5.1 per 100 overrides). The rate of ADEs was higher with inappropriate vs appropriate overrides (9.4% vs 4.3%; P = .038). CONCLUSIONS: The override rate was nearly 90% for even the highest-severity DDI alerts, indicating that stronger suggestions should be made for these alerts, while other alerts should be evaluated for potential suppression.

Lab monitoring and acute care utilization during initiation of renin angiotensin aldosterone inhibitors or diuretics in chronic kidney disease.

Renin angiotensin aldosterone system inhibitors (RAASi) and diuretics are among the most frequently prescribed anti-hypertensives. Individuals with chronic kidney disease (CKD) are particularly at risk for electrolyte disturbances and kidney injury but the appropriate use of lab monitoring following RAASi or diuretic initiation is uncertain in CKD.We describe the frequency and time interval of lab monitoring during initiation of RAASi and diuretics in CKD and assess whether close lab monitoring associates with one-year risk of emergency department (ED) visit or hospitalization.We evaluated an observational cohort of 8,217 individuals with stage 3-5 non-dialysis CKD newly prescribed a RAASi (52.3%) or diuretic (47.7%) from thirty-six primary care offices affiliated with Brigham and Women's Hospital and Massachusetts General Hospital between 2009 and 2011.Overall, 3306 (40.2%) individuals did not have pre-prescription labs done within 2 weeks, and 5957 (72.5%) did not have post-prescription labs done within 2 weeks which includes 524 (6.4%) individuals without post-prescription within 1 year. Close monitoring occurred in only 1547 (20.1%) and was more likely in individuals prescribed diuretics compared to RAASi (adjusted OR 1.39; 95%CI 1.20-1.62), with CKD stage 4,5 compared with stage 3 (adjusted OR 1.47; 95%CI 1.16-1.86) and with cardiovascular disease (adjusted OR 1.42; 95%CI 1.21-1.66). Close monitoring was not associated with decreased risk of ED visit or hospitalization.Close lab monitoring during initiation of RAASi or diuretics was more common in participants with cardiovascular disease and advanced CKD suggesting physicians selected high-risk individuals for close monitoring. As nearly 80% of individuals did not receive close lab monitoring there may be value in future research on electronic physician decision tools targeted at lab monitoring.

Patient-centered Pharmacist Care in the Hemodialysis Unit: a quasi-experimental interrupted time series study.

BACKGROUND: Nonadherence to medications by patients requiring hemodialysis (HD) leads to unfavorable clinical outcomes. Limited data exist to demonstrate the effect of incorporating patient-centered interventions using concepts of medication therapy management and motivational interview by pharmacists on pharmacoadherence in patients requiring HD. Therefore, we assessed the impact of patient-centered pharmacist care on pharmacoadherence and its outcomes in patients requiring HD. METHODS: Adult patients who had received outpatient HD for at least 3 months were enrolled. The study was conducted from October 2016 to April 2017. Pharmacists interviewed the patients at month 1, 2, 4 and 6, and the intervention (comprehensive review) occurred at months 3 and 5. The primary outcome was the change in pharmacoadherence as assessed by pre-HD serum phosphate levels and the differences in the number of medications between patient' self-report and medications records at the electronic healthcare records (EHRs). The secondary outcomes included changes in systolic blood pressure (SBP), glycosylated hemoglobin levels, serum low-density lipoprotein (LDL) levels, and the prevalence and types of medication-related problems (MRPs). RESULTS: Seventy-two patients were enrolled. Their median age was 59 (interquartile range: 47-67.5) years, and 53% were men. Pre- and post-intervention pharmacoadherence, as indicated by serum phosphate levels and the differences in the number of medications between patient' self-report and the medication records at the EHRs, did not significantly differ (p = 0.682 and 0.348, respectively). Mean SBP and mean LDL did not significantly change post-intervention. The median number of MRPs declined between Months 3 and 5 (p = 0.002): the prevalence of MRPs at Month 3 was 44.9% (95 confidence interval [CI]: 40.4-49.3) and decreased to 29.8% (95 CI: 25.6-34.3) at Month 5. Drug use without indication was the most frequent MRP (23.9%). CONCLUSIONS: Patient-centered pharmacist care did not result in significant changes in pharmacoadherence. However, its clinical utility as a tool to identify and mitigate MRPs in patients requiring HD is indisputable. TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT03576404 (retrospectively registered on July 3rd, 2018).